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The classical asymptotic equipartition property is the statement that, in the limit of a large 
number of identical repetitions of a random experiment, the output sequence is virtually certain to 
come from the typical set, each member of which is almost equally likely. In this paper, we prove 
a fully quantum generalization of this property, where both the output of the experiment and side 
information are quantum. We give an explicit bound on the convergence, which is independent of 
the dimensionality of the side information. This naturally leads to a family of Renyi-like quantum 
conditional entropies, for which the von Neumann entropy emerges as a special case. 



I. INTRODUCTION 

In this paper, we prove a fully quantum version of 
the asymptotic equipartition property (AEP). While the 
classical AEP applies to a random experiment with clas- 
sical outcomes, here we consider the generalization to 
experiments that require a quantum description. Our 
version of the AEP then refers to typical properties of 
outcomes of the experiment relative to some side informa- 
tion, i.e., additional information obtained in the process 
of the experiment. We call it fully quantum because the 
outcomes as well as the side information may be quan- 
tum systems. We note here that in classical versions of 
the AEP the side information is not usually described 
explicitly, but is already included in the specification of 
the distribution of the experimental outcomes (i.e., one 
considers the probability distribution conditioned on the 
side information) . This is not possible in a fully quantum 
context, where the side information may be entangled 
with the outcome and a quantum analogue of conditional 
probability distributions cannot be defined. 

We will first discuss the classical AEP and rewrite it in 
a form that can then be generalized to the fully quantum 
setting. We sketch a possible proof of the classical ver- 
sion and our proof of the fully quantum AEP will follow 
similar lines. 



A. Classical AEP 

The AEP (cf. Theorem 3.1.1 in 1]) is central to classi- 
cal information theory because it establishes the Shannon 
entropy^ , 
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We use log to denote the binary logarithm. 



as the relevant quantity for various problems involving 
independent and identically distributed (i.i.d.) random 
variables. It is a direct consequence of the weak law of 
large numbers and states that, for large enough n, the 
outcome of a random experiment given by an i.i.d. se- 
quence X" = (Ai, X2, . . . , Xn) & of random vari- 
ables distributed according to a probability distribution 
P on a set X will almost certainly be in a set of ap- 
proximately 2"^^^^' typical events that each occur with 
a probability close to 2^"^("^). 

Consider, for example, the problem of source compres- 
sion. There, one asks for the number of bits needed to 
store the outcome of the above random experiment. In 
typical information theoretic applications, we tolerate a 
small probability of failure. The AEP tells us that if we 
ignore non- typical events, we are almost certain not to 
have an error. We thus only need nH{X) bits to store 
the whole sequence, i.e. H{X) bits per element. 

This can alternatively be formulated in terms of the 
entropies 

H^{X) :— — logmaxP(a;) and 

H„{X) := log \{xeX : P{x) > 0}|. 

We also informally introduce smooth min- and max- 
entropies denoted H^-^^.^{X) and Hf^^^{X), which will be 
defined precisely in Section |TT1 The smooth min-entropy 
is constructed by ignoring the most probable events in X 
up to total probability e and taking Hao of the remaining 
distribution. Similarly, the smooth max-entropy ignores 
the least probable events and is closely related to Hq . In 
terms of these entropies, the AEP is equivalent to the 
relations 

lim lim -i/,^^i„(A") = H{X) and (1) 
lun\un-H^,^{X-)=H{X). (2) 

e— >0 n— >oo n 

These relations have been generalized to the case of con- 
ditional entropies (for a non-asymptotic version, see [5]). 

Returning to the example of source compression makes 
clear the second of these relations. In order to store (with 
certainty) the outcome of a single random experiment. 
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one needs Hq{X) bits. Furthermore, if one tolerates a 
small probability of failure, only roughly H^^^{X) bits 
are required. On the other hand, in the case of a large 
sequence of i.i.d. random variables, the AEP tells us that 
H{X) bits are needed for each element of the sequence, 
and hence relation ([2]) follows. A similar argument can 
be made to illustrate relation ([T]) using randomness ex- 
traction 3. 

We now sketch a proof of the AEP ([T|). We use the 
Renyi entropies [1| 

H^{X) :=^log^P(a;)", a G (0, 1) U (1, 00), 
1 — a ^ — ' 

(3) 

for which Hao (ct ^ 00), 0) and the Shannon 

entropy (a^ 1) are defined as limits. Furthermore, the 
entropies Ha are monotonically decreasing in a and, as 
shown in Q , the Renyi entropies with a > \ are close to 
the smooth min-entropy in the sense that 

> H^{X) - log i a > 1 (4) 

while those with a < 1 are close to the smooth max- 
entropy. Note that the error term -^^^ log 1/e in (|3|) 
diverges when we try to recover the Shannon entropy. 
However, in the case of an i.i.d. sequence we find 

-Hl,^{X^) > HJX) - ^ logs, (5) 
n n(l — a) 

where we have used H^{X^) — nH^{X). We proceed 
by bounding limg^o limn^oo -ffmin("^") from above and 
below. To get the lower bound, we choose a = 1 + \l \fn 
and take the limit n 00 in The upper bound 

essentially follows from H^-^^J^X) < H{X). 

B. Fully Quantum AEP 

The AEP was first generalized to situations where the 
outcomes A of the random experiment are quantum sys- 
tems, while the side information remains classical. In 
this case the side information does not need to be mod- 
eled explicitly but can be included in the description of 
the output states (see e.g. d, H, 0, In this paper 
we consider a generalization to a fully quantum AEP, 
involving possibly quantum mechanical side information 
B.^ A preliminary version of the result has appeared in 
(see the discussion below for a comparison). Similar 



result have also been found in the context of quantum 
hypothesis testing (e.g. [ll[Il|,[l2). 

Theorem 1 (AEP). Let Ha and Hb be finite- 
dimensional Hilbert spaces, p^B o, bipartite state on Ha ® 
Hb andneN s.t. pf^ is an i.i.d. state on {Ha^Hb)®"^ , 
then 

lim lim iff^i„(A"|B")„»„ = H(A\Q)„ and (6) 

£—►0 n^oo n 

lim lim ii/,^,JA"|B"),«„ = H{k\Q), . (7) 

e-^O ri^oo n 

This relation is expressed in terms of quantum versions 
of the min- and max-entropies ^ and the conditional von 
Neumann entropy which will be defined precisely below. 
The reader unfamiliar with quantum entropies is also re- 
ferred to [H, [31 for many of their properties and appli- 
cations. 

In this contribution, we prove a non-asymptotic version 
of Theorem [1] that gives a lower bound on iJ^;jj(A"|B") 
for finite n (cf. Theorem The bound for finite n 
has the property that the deviation from the asymptotic 
bound (the term S{e,'i]) in Theorem [5]) only depends on 
conditional min- and max-entropies evaluated for Pab but 
is otherwise independent of the dimension of the Hilbert 
spaces Ha and Hb- More precisely, our bound is inde- 
pendent of the Hilbert space dimension of Hb- This is 
particularly important for applications in the context of 
cryptography, where quantum systems may be controlled 
by an adversary. In this case, it is often difficult or impos- 
sible to bound their dimension, whereas the conditional 
entropies can nevertheless be estimated. 

It is possible to obtain a statement similar to Theo- 
rem [1] using typical subspaces. However, proofs of this 
type inevitably lead to bounds involving the dimensions 
of both Hilbert spaces Ha and Hb'^ and hence to a qual- 
itatively weaker result than the one established here (in 
particular, no reasonable bound could be obtained for 
high-dimensional Hilbert spaces). We note that our proof 
technique is different from the one used in where the 
result also explicitly depends on the dimension of the 
Hilbert space Ha- 

Our proof is based on quantities that can be seen as a 
quantum generalization of Renyi entropies (Section [Hi . 
A central ingredient is a family of inequalities that gener- 
alize (U) to the quantum domain fSection lllip . Together 
with a quantitative bound on the difference between the 



^ We consider this result an extension of the AEP in the sense 
that it takes the role of the classical AEP in a quantum informa- 
tion context. Namely, if an information theoretic problem can be 
solved in terms of min- and max-entropies in a single-shot sce- 
nario, the asymptotic result for i.i.d. states follows via the AEP 
(and, thus, can be expressed in terms of von Neumann entropies). 
The classical AEP follows as a special case of our result. 



^ To our knowledge typical subspaces cannot be defined in a fully 
quantum setting. Instead, it is necessary to first bound the condi- 
tional entropies in terms of (unconditional) entropies of the joint 
system AB and of system B separately. The typical subspace 
arguments can then be applied individually to get an asymptotic 
limit of _ff(AB) — -H(B) = J?(A|B). Bounds on the convergence 
derived from this argument will depend on the convergence of 
the individual terms and thus in general on the Hilbert space 
dimensions of Wab and "Hb (see 0]). 



3 



generalized Renyi entropies and the von Neumann en- 
tropy (Section IIV[) . this leads to the main claim (Theo- 
rem |9] in Section N} . 

The technical tools used for the derivation of our re- 
sults (in particular Lemma [HI in Appendix may be of 
independent use — for example, they allow for a simple 
proof of the strong sub-additivity of the von Neumann 
entropy (cf. Lemma [5] and [12[]). 



II. QUANTUM RENYI ENTROPIES 

In this section, we define the various entropies used and 
explore some of their properties. Proofs of the lemmas 
can be found in Appendix [Bl Given a finite-dimensional 
Hilbert space H, we use VCH) to denote the set of posi- 
tive semi-definite operators on Ti. The set of normalized 
quantum states S{H) :— {p G V{Ti.) : tr p — 1} and 
the set of sub-normalized states S<{Ti.) :~ {p G V{H) : 
tr p < 1} can now be defined. Indices are used to denote 
multi-partite Hilbert spaces, e.g. Hab = ^ ^b- Let 
Pab G S{T-Iab) be a bipartite state and CTb G S{Hb), then 

i7(A|B)p|^ := lhntr(pAB(lA<»log(crB+flB)-log/9AB)) , 

where 1a and 1b are the identity operators on Ti.A and 
Ti.B , respectively. The conditional von Neumann entropy 
can then be recovered by 



i/(A|B)p 



= max i/(A|B)p|, 

cjb to(,rtB ) 



H{A\B) 



p\p ' 



where Pb — trA(pAB) is obtained by taking the partial 
trace on A of Pab- We use indices to denote the differ- 
ent marginal states of multi-partite systems and often do 
not mention explicitly when a partial trace needs to be 
taken, since this information is contained implicitly in the 
notation of the entropies.^ We define the min-entropy: 

Definition 1. Let Pab G S<{Ti.AB) and ctb G S{Ti.B), then 
the min-entropy of A conditioned on B of the state Pab 
relative to Cb is defined as 

H,„i„(A|B)p|, sup {A G R : 2"^ 1a ® ^b > Pab} (8) 

Furthermore, we define 



entropy is its dual with regards to a purification Pabc of 
Pab on an auxiliary Hilbert space 7ic'^ 

Definition 2. Let Pabc G S<{T-Cabc) be pure, then the 
max-entropy of A conditioned on B of the state 
defined as 

i/„_(A|B), :=-i/,„i„(A|C),. (10) 

The quantum entropies can be ordered as follows: 

Lemma 2. Let Pab & S{Hab), then 

i/,„i„(A|B), < H{A\B), < i7„_(A|B),. (11) 

In order to define smooth versions, we consider the set 
of states close to p in the following sense. For e > 0, we 
define an e-ball of states around p G S{'H) as 

B'ip):={peS<{n):C{p,p)<e}, (12) 



where C{p,p) :— y/l — F'^ip, p) as proposed in [l5| is a 
distance measure (on normalized states) based on the fi- 
dehty F{p, p) := tr|y/py^|. We use this choice of measure 
because it is invariant under purifications and is directly 
related to the trace distance for pure states.^ Smoothed 
versions of the min-entropy are then defined: 



^min(A|B)p|„ 

Similarly, we define 



- max 77„,i„(A|B)p|^ , 

Pab6o^(pab) 

- '^a? ,^^min(A|B)p. 

PABeB=(pAB) 



^^maJA|B)p := ^ min i/,„,JA|B)p . (13) 

PAB&B' (pab) 

The smoothed entropies maintain the duality relation 

Hl^^(M'Q)p = -HlMC)p. (14) 

Both entropies are independent of the Hilbert spaces used 
to represent the density operators locally; namely, given 
Pab G S{T-Lab), Ten G S{Hc.u) and two isometrics U and 

V s.t. Tco - (c/®y)pAB(c/t(»yt), we have 

-f^min(A|B)p = i7^ji„(C|D)^ , H^^^{A\B)p = H^^^^^{C\D)r 

Moreover, let (Tb G S{Hb) and uj^ ■— VasV^ then 

i/,^i„(A|B)p|, = i/,t,iJC|D),|^. (15) 

For a more in-depth treatment of smooth conditional en- 
tropies and their basic properties, we refer to [l6| . 

Next, we introduce a family of Renyi- like conditional 
entropies: 



^fmi„(A|B)p := max i/^i„(A|B)p| 



o-bG5CHb) 



(9) 



Clearly, H^^^^{A\B)p\^ is finite if and only if 
supp{(Tb} ^ suppIpb} and — oo otherwise. The max- 



* For example, given a state Pabc, the entropy (A|B)p is meant 
to be taken with the marginal states pab = trc(pABc) and pb = 
trAc(PABc)- 



Note that this quantity is different from the //max used in earlier 
work (e.g. Q). However, the definition used here (and introduced 
in [iJl) chosen because it satisfies the duality relation (IIOI I. 
When TYb — C, we recover the classical Renyi entropy //i/2- 
Note that the smooth versions of //1/2 (cf- eq. I I13I I) and Hq are 
equivalent up to additive terms logarithmic in the smoothing 
parameter Q, which disappear in the asymptotic statements. 
^ In fact, C(p, p) corresponds to the minimal trace distance be- 
tween purifications of p and p if tr(p) = tr(p) = 1. 
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Definition 3. Let € 5(7^ab), CTb € 5(7^b) and a G 
(0, 1) U (1, oo), then the a-entropy of A conditioned on B 
of the state Pab relative to CTb is given by 

iIJA|B),|, := _^logtr(p^^(lA®aB)'""), (16) 
1 —a 

when (Tb is invertible and lim^^Q H^{A\B) p^^_^_^l other- 
wise. 

Note that for a > 1 the hmit is finite if and only if 
supp{ctb} 12 suppIpb} and — oo otherwise. A similar 
quantity appears in quantum hypothesis testi ng [ill. [T7| 
and as a quantum relative Renyi entropy in [T^.ll8l.ll9j . If 
TYb = C is trivial, we recover the classical Renyi entropies 
([3]). The entropies Ho (a— >0) and Hoc (a^oo) can be 
defined as limits. Moreover, the von Neumann entropy 
is recovered by continuous extension to a = 1 : 

H,{A\B),^„ := hm i/„(A|B)p|, - H{A\B),^, . 

a — *i 

Unlike their classical counterparts, the quantum condi- 
tional min- and max-entropies cannot be recovered as 
sgecial cases of a-entropies. However, it can be shown 
[l4| that, for any CTb G 5(7^b), 

^max(A|B)p= max log {p^^,t^®T^) > Hy^{k\Q)p\,. 

(17) 

Furthermore, using the eigenvalue decompositions Pab — 
'^iNX*! and 1a «) ctb = J2j A*j|j>(j|, we have 

-f^oo(A|B)p|^ = lim - log max < i?„ii„(A|B)p|„. 

Nevertheless, the a-entropies share some of the useful 
properties of their classical counterparts: 

Lemma 3. Let pj^^ G S{Ti.AB) o,nd G S{T-Ib), then the 
entropies H^{A\B)p\g- are monotonically decreasing in a. 

Furthermore, the entropies are additive, e.g. evaluation 
for an i.i.d. state pfg relative to another i.i.d. state erf" 
results in 

iJJA"|B"),«„|,«„ = nH JA\B)p\, . (18) 

The a-entropies are independent of the Hilbert spaces 
used to represent the density operators locally: 

Lemma 4. Let Pab G S{Hab), cTb G S{Hb), e 
d), G S(T~lu) and U, V isometries s.t. Tcd — 
(L/(g)F)pAB(?7^«)Ft) anduJo^VaBVf. Then, 

FJA|B),|, = i/JC|D),|_ (19) 

Conditional entropies are measures of the uncertainty 
about A given B, hence we expect them to satisfy a data 
processing inequality, i.e. local processing by a trace- 
preserving completely positive map (TP-CPM) on sys- 
tem B cannot decrease the conditional entropy. The a- 
entropies for a £ [0, 2] have this property. 



Lemma 5. Let a e [0,2], Pab G iS(Wab), ctb G 5(Hb), 
Tac G S{Hac), G SiUc) and £ a TP-CPM s.t. Tac = 
2 (8) £{pab) and luc — E^Ob), where X is the identity on 
S{T-Ia), then 

i?JA|B)p|, <i/„(A|C).|„. (20) 

When the partial trace over a subsystem takes the role 
of the TP-CPM, Lemma [S] is equivalent to strong sub- 
additivity in the case of the von Neumann entropy. We 
find the following duality relation for a-entropies: 

Lemma 6. Let Pabc abc) be pure and a £ [0,2], 

then 

H^,iA\B)p\p = -H,_JA\C)p\p. (21) 

The duality relation of the von Neumann entropy — 
H{A\B)p = -iJ(A|C)p — follows in the limit a ^ 1. 



III. LOWER BOUND ON SMOOTH 
MIN-ENTROPY 

Our main tool for proving the fully quantum AEP is a 
family of inequalities that relate the smooth conditional 
min-entropy iJ^i„(A|B) to H^{A\B) for a £ (1,2]. The 
result is a quantum generalization of (jj]). 

Theorem 7. Let Pab G S{Hab), <^b G S{Hb), £ > and 
a £ (1,2], then the following inequality holds: 

iI^i„(A|B)p|, > H^{A\B)p^, - log |. (22) 

Proof. We consider two cases: (1) The a entropy di- 
verges and the inequality holds trivially. (2) We have 
supp{pb} C supp{crB}- In this case, we can find an 
isometry Ti^ — > Hb that maps a a'-^ to ctb and p^^ to Pab 
s.t. (Tg lias full support. The min- and a-entropies are 
invariant under this isometry due to (|15p and Lemma 31 
thus, we henceforth assume that ctb is invertible in this 
proof. 

We use Appendix[C]to get a first bound on H^^^{A\B) ; 
in particular, let A be chosen s.t. Lemma [15] holds for 
e (cf. Remark \W\\ . Next, we introduce the operator 
X := Pab — -^Ia <8i (Jb with eigenbasis The 
set 5+ C 5 contains the indices i corresponding to pos- 
itive eigenvalues of X. Hence, P"*" := J2ies+ 
is the projector on the positive eigenspace of X and 
= A as defined in Lemma [151 Furthermore, 
let ri := (V'i|pAB|V'i) > and Si := (V'j|1a <S) a-B\ipi) > 0. 
It follows that 

ri 

Vig5'+ : ri - As, > and - — > 1. 

A Si 
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For any a € (1, 2], we bound e in Lemma [T5] as follows: 



~2 



< 



tr(A) ^^n^ As, < ^ 

Q-l 



(23) 



ies 



Next, we apply Lemma [14] to the functional Sg^ , 
where ga '■ t i—f is operator convex for a G (1,2] 
(cf. Section V.2 of 0). We use the TP-CPM A ^ 

Lies \'4'i){'4'i\A\ipi){ipi\ to obtain 

Sg^ (Pab, 1a ® (Jb) = tr(p^3(lA ® a^y-") > rf 



Substituting this into ((23)) . we find 
2 



A""^<^tr(p^3(lA®aB)i-"). 



Finally, taking the logarithm on both sides, dividing by 
1 — a < and applying Lemma [15] results in ([22]) . □ 



IV. LOWER BOUND ON a-ENTROPIES 

We will use Theorem [7] to get a lower bound on the 
min-entropy in terms of a-entropies, hence, it remains to 
find a lower bound on the a-entropies in terms of the von 
Neumann entropy. In turn, the bound on the convergence 
will depend on the smoothing parameter e and a contri- 
bution T(A|B) that describes how fast the a-entropies 
converge to the von Neumann entropy. 

Definition 4. Let Pab G S{Hab) and CTb G S{Hb), then 
we define the a-entropy convergence parameter 



Let {\i)}i be an orthonormal basis of Hab and = 
Hab a copy of Hab- The state I7) := J2i N) N) 
the (unnormalized) fully entangled state on Hab (Xi H'ab ■ 
We introduce a purification |0) := {^/Pab <8i 1ab)|7) of 
Pab- To simplify notation, we use /? := a — 1 as well as 

X := Pab ® (1 ® cr-l)^. 

Let us first approximate H^{A\B) for small /? > 0: 

i/jA|B),|. = -iiog(<^|x^i</.) > ^(1 - m^m, 

where we used In a; < x — 1 for all a; > 0. We now 
expand the exponential for each eigenvalue t > of 
X as follows: = 1 + /3\nt + ri3{t), where r/3(i) := 
- /31nt - 1. This leads to 



> 



/31n2 



(-/?(0|lnX|</.)-(0|r0(X)|<^)) 



= if(A|B),|,- 



1 



(0|r^(X)|0). (26) 



/31n2 

To simplify this further, we note that 

rp{t) < 2(cosh(/31nt) - 1) ==: sp^t) . 

It is easy to verify that is monotonically increasing 
for t > 1 and concave in t for /3 < 1/2 and t € [3, 00). 
Furthermore, we have S/3(t) = 5/3(7) ^^'^ ^pi^"^) — S2p{t). 
We use this to write^ 



(27) 



T(A|B)p|^ := 2"^^='/2(^l^)''i" + 25^V2(^l^)''i<' + 1 . (24) I '"/3(^ )!'/'> < {(t'\s2p[vX + — 



When CTb ^ Pb, one can use pT)) and its dual relation 
Hy^_{A\B)pip > i7„i„(A|B)p (cf. ([ini) and Lemma [S]) to 
write 



Next, we apply (|27p to the matrix element in (|26|) and 
use the fact that the operator ^/X + 1/ + 1 has its 
eigenvalues in [3, 00) and 2f3 < < | together with 

Lemma ITT] in Appendix \X[ 

) 10) < 52/5(77), 
(28) 

where we substituted 77 = {(j)\^/X+l/ Vx+l\(j)) . Taylor's 
theorem and an expansion around (3 = gives an upper 
bound on Sfj (t): sp{t) < /32(lnt)2cosh(/31nt). Hence, 



T(A|B)p|p < V2"^m.„(A|B)p + ^2«n,ax(A|B)p + ^ ^ 

We can now state a bound on the a-entropies for a close 
to 1 as follows: 

Lemma 8. Let Pab G S{Hab), ctb G S{Hb), V = 
T(^|_B)p|o. and 1 < a < 1 + then the following 

inequality holds: 

i?JA|B),|, > i/(A|B)p|, - 4 (a - l)(log77)2 . (25) 

Proof. We assume that CTb is invertible in this proof. The 
general result then follows by the arguments outlined at 
the beginning of the proof of Theorem [7] 



/31n2 



S2i3{v) < 4/3(logr/)2ln2cosh(2/31nr7) 
<4/3(logr;)2. 



(29) 



where we simplified the expression (for convenience of 
exposition) using In 2 cosh(ln 3/2) < 1. The lemma now 
follows after we substitute ^ and ^ into □ 



Adaptions of this step lead to different bounds. Here, we are 
interested in a bound that can be expressed in terms of and 



H: 



3/2- 
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V. QUANTUM AEP 

One could use Theorem[71 together with the arguments 
given for the classical case in Section II Al to prove (O 
directly. In many applications, it is useful to have an 
explicit lower bound on H^^^{A\B). We derive such a 
bound, from which the asymptotic version ([H]) is a corol- 
lary. 

Theorem 9. Let p^B e S{Hab), e > 0, ry = i:{A\B)p\p 
and n E N s.t. pf^ is an i.i.d. state on Tif^, then 

ii/„^,,(A"|B"),«„ > i/(A|B), - , 
where, for ri> ^ log ^ , the error term is given by 



(30) 



(5(e,ry) := 41og?7^/log 
Proof. By definition, we have 

--f^min(A"|B")p(9-> > -i/^,in(A"|B")p8>,x|p®„ . 



We use Theorem [3 the additivity property (|18p of the 
a-entropy and Lemma [8] to get a bound on the rhs. Let 
a := 1 + for a parameter yU (to be optimized over), 

then 

rhs. > ii/JA"|B"),«„|,«„ - , ^ .. log 4 
" ' n[a — 1) 



^a(A|B)p|p-^log| 



> i/(A|B)p|p - Ar^iogl + i(log77)2). (31) 



We want to choose /i such that it minimizes the ex- 
pression /zlog -\- iXogrj)^ . However, the requirement 
in Lemma [5] restricts the choice of ji for 



a < 1 



log 3 
4 log »7 



any fixed n, hence, the error term 6{e,ri) is in general 
also a function of n. Nonetheless, for large enough n the 
optimum, p^, , can be reached^ and we get 



(log77)2 ^ 8 (log 77)^ 8 2 



5 M* 5 



log- 



Substitution of this expression into ([31]) leads to ([30]) . □ 

Remark 10. The proof of Theorem [9] can be generalized 
to i?^i^(A|B)p|o.. The generalized theorem reads: For 
Pab € SCH ab) and G S{Hb), we have 



(5(£, yy) 

-f^min(A"|B")p»r.|o.®„ > _ff (A|B)p|^ j=- 



To verify this, evaluate an upper bound to a = 1 + {2/x»y'n) ^ 
using the expression for n in II32I I and note that \/5/2 < log 3. 



where n and 6{e, rf) as in Theorem[9]and 77 = T(A|B' 



p|cr- 



The generalized asymptotic equipartition property 
stated in Theorem [T] follows as a corollary. 

Proof of Theorem [IJ We first show the min-entropy rela- 
tion ([6]) . Taking the n ^ 00 limit in Theorem [9] gives 

lim lim -i/^i„(A"|B")„®,^ > iJ(A|B)p. 

However, since, for e — > 0, the min-entropy is smaller 
than the Shannon entropy (cf. Lemma [2]), we get the 
desired result. To see this, note that there exists a 
G B-{pf^) s.t. 



^n^in(A"|B^ 



iJ,„i„(A"|B")p < iJ(A"|B^ 



(33) 



We now use the continuity of the von Neumann entropy 
under small perturbations of the state as expressed in 
Fanncs' inequality (cf. [l^]). This ensures that, for finite- 
dimensional Hilbert spaces, the difference between the 
Shannon entropies evaluated for pf^ and /5a" b" scales at 
most linearly in n (i.e. logarithmic in the Hilbert space 
dimension): 



lim 



1 



Together with 



<0{e). 



iJ(A"|B")p-i/(A"|B")p, 
, this leads to 

< F(A|B)p 



1 



lim lim -i/,^i„(A"|B") 

e— »0 n— too n 



The max-entropy relation ([7]) follows after we substi- 
tute the duals of the smooth min-entropy (fT4|) and the 
von Neumann entropy (PT|) into □ 



APPENDIX A: TECHNICAL RESULTS 

We discuss some properties of convex and operator 
convex^" functions. Let 7i, TL' be Hilbert spaces and 
\(t>) ETi. We start with a straightforward application of 
Jensen's inequality: 

Lemma 11. Let f be a convex function on [a,b] and X 
an operator onTi. s.t. al < X <bt. Then, 



m{xM>fMxm. 



^ Furthermore, note that all results of this paper can also be stated 
in terms of relative entropies instead of conditional entropies. 
For example, in the language of [2l| . Remark 1101 reads: Let 
p,(T a H and e > 0. With n and 5 as in Theorem (9] we have 
iDg,^x(p®"||cr®") < S{p\\a) + &{£,'n)/^, where the smoothing 
is over an e-ball around p as defined in the present work and 
rj = 2^253/2(^1^) _)_ 2-V2Si/2(p|k) _|_ 

A continuous function / on [0, 00) is operator convex if f(^\{A + 
B)) < \ {f{A) + /(B)) for all positive semi-definito matrices A 
and B. 
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A generalization of Jensen's inequality to operator con- 
vex functions was shown in 23]: 

Lemma 12 (Operator Jensen's Inequality). Let f be a 

continuous operator convex function on [0, oo) and v an 
isometry Ti. ^ Ti' . Then, for all C > on TC it holds 
that 

v^f{C)v>f{v^Cv). 

We will now discuss Lemma 1141 originally proven by 
Petz [iJl, which establishes the monotonicity of certain 
functionals Sf under TP-CPMs and is of independent 
use in quantum information theory (see e.g. [TH . IT3|). 
Let 7i be a Hilbert space with orthonormal basis 
7Y' = 7i be a copy of and I7) \i) ® \i) be the 

(unnormalized) fully entangled state on H(E)'H' . Then, for 
any continuous function / : [0, 00) R with /(O) = 0, 
and operators A > 0, B > 011 H, we define 

Sf{A, B) := {-f\{VB ® t)f{B-^ ® A^){Vb (g) , 

where (•)-^ denotes the transpose with respect to {\i)}i 
and 1 is the identity operator on Ti.. More generally, for 
any B > 0, we define 

Sf{A,B)=^mSf{A,B + Cl). (Al) 

The functional Sf{A,B) is independent of the Hilbert 
space used to represent A and B in the following sense: 

Lemma 13. Let U : Ti. ^ Ti. be an isometry, then for all 
operators A > 0, B > on Ti: 

Sf{A,B) = Sf{UAU\UBU^). 

Proof Let A = and B = with 

eigenvalues A.; > 0, > and orthonormal bases 
and respectively. Now, using (7|Ar(g)l|7) = tr(Ar) 

and {X (X) 1)|7) — {1 Ar^)|7) for any operator X, we 
get 

Sf{A,B) = lhn^(^, +0/ (-^) ■ 

The isometry U keeps the eigenvalues and the scalar 
product {i\j) invariant. Furthermore, any zero eigen- 
values introduced do not contribute to the sum since 
they lie on a space orthogonal to the image of U, and 
/(0) = 0. □ 

Lemma 14. Let f be operator convex on [0, 00) and let 
£ be a TP-CPM, then for all operators A>Q,B>Oon 
Ti: 

Sf{A,B)>Sf{£{A),£{B)). 

Proof. Every TP-CPM can be expressed as an isometry 
followed by a partial trace (cf. Section 8.2). We have 
already established in Lemma [T3] that Sf is invariant 



under isometrics. To show monotonicity under partial 
trace, we let Ti = Tii 7^2 with local bases and 
{|i)2}i, respectively. We introduce Ti'i = Tii, the (unnor- 
malized) fully entangled state I7) — ■ |j)i<E'|j)2'8'|«)i(8' 
\j)2 and its marginal |7)i = ® It remains to 

show that Sf{A,B) > Sf{Ai,Bi), where Ai = tr^iA) 
and Bi = tr2(-B). We will show this under the assump- 
tion that B is invertible and the result for general B 
will follow from the continuity (by definition) of 5/ when 

Let us define a linear map v -.Tii® Ti'i Ti®Ti' hy 




The map v is an isometry, i.e. v'^v = In and satisfies 

u{y/B^ (g, tl\j) i) ^ VB(g> li2h) . (A2) 

Moreover, we have tr2(^"^) = Af , since the transpose is 
taken in the product basis. Hence, it follows that 

iy\B-^ (g) A^)v = 1 ® Al . 

Next, we apply Lemma fT2l to get 

® A^)v > f{v\B-^ (g A^)v) = f{B^^ g) Al) . 

Finally, using (jA2|) . we recover Sf{A,B) > Sf{Ai,Bi) 
by taking the matrix element for (a/BT® li)|7)i on both 
sides of the inequality. □ 

APPENDIX B: PROOFS OF CLAIMS IN 
SECTION |TT] 

For completeness, we prove various properties of the 
min-, max- and a-entropies presented in Section HIl 

Proof of Lemma [H It is sufficient to prove the first rela- 
tion", since i/^i„(A|B) < H{A\B) implies /f„,^^(A|C) > 
H{A\C) by the duality relations. 

H{A\B)p = max tr(pAB(log(lA «> CTb) - logpAs)) 
cTBesCHB) 

> tr (pAB(log(AlA g) a'g) - logpAe)) - log A 

> i/^iJA|B)p , 

where we chose A > and a'^ £ iS(7Yb) such that they 
optimize ([SD and Hence, -logA = i/,„i„(A|B)p. Fur- 
thermore, it follows from ([5]) that AIa^ct^ > Pab- Then, 
using the operator monotonicity^^ of i log t (cf . Chap- 
ter V in |2C|), we find that the remaining term is posi- 
tive. " □ 



See also Lemma 10 in [21II for an alternative proof. There they 
define the relative entropy -Dmax(pB||o"B) which, for Ha — C 
trivial, is equal to —H^^^{A\Ii)p^^. 

A function / on (0, 00) is operator monotone if A > _B implies 
f{A) > f{B) for any strictly positive Hermitian matrices A and 
B. 
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Proof of Lemma [5l We prove this statement for invert- 
ible CTb and the general statement then foUows by con- 
tinuity. Using the (unnormaUzed) fully entangled state 
I7) as in Appendix [XI we define a purification |0) := 
(a/Pab ^ 1ab)|7) of Pab- Furthermore, we set (3 :— a — 1 
and X Pab ® (1 ® (J^^)'^ . It is easy to verify that, for 
/ : 1 1-> tlogi. 



4log(0|X^|0) 



and 



da 



l (0|X^logX| 



/52 (^IX/^I^) 

The statement of the lemma then follows from the con- 
vexity of / together with Lemma [TT] □ 

Proof of Lemma The a-entropies can be expressed in 
terms of the functionals of Appendix [X] Given the con- 
tinuous functions ga '■ t t"' and h : t t—^ —tlogt that 
satisfy 5q(0) = for a € (0, 00) and h{0) = 0, we write 

r^log5g„(/9AB,lA® c^b) ae{0,l) 
ff„(A|B)p|„ = <^ S',,(pab,1a®CTb) a = l 

[-■^log5'g„(/9AB,lA «) CTb) ae{l,oo) 

(Bl) 

The proof is now a straightforward application of 
Lemma [T3l with isometry UiS)V to the functionals Sh and 
Sg^. Note that {U(^V){lA®crs){W (^V^) = UW ^co^, 
where UW and Ic are interchangeable in the definition 
of -ff(j(C|D)T-|j^, since Tc has its support on UU^ . The 
statements for a — s- and a — s- 00 follow by continu- 
ity. □ 

Proof of Lemma O The proof is a straightforward appli- 
cation of Lemma [H with TP-CPM X « £ to the func- 
tionals in (|Bip . In the von Neumann limit a 1, we 
write 

H{A\B)pl„ ^ 5'h(/5AB,lA ® CTb) 

where we used that h : t 1-^ —tlogt is operator concave 
on [0,00) (cf. Chapter V in [20|). Similarly, we use that 
ga : t t—f t" on [0,oo) is operator concave for a € (0, 1) 
and operator convex for a G (1,2] (cf. Chapter V in |20l |) 
as well as continuity at a = to prove the statement for 
aG[0,2]. □ 

Proof of Lemma\^ We write Pabc = and note that 

the marginal states Pab and pc satisfy (pab ® Ic)!'?) = 
(Iab ® Pc)^)- The same applies to Pb and Pac- Thus, 

(l-a)i7„(A|B),|, 

= logtr(p^3(lA®PB)'-") 

= log(i?|(pAB ® 1c)""'(1a ® Pb ® lc)'""|i?) 

= logtr((lA®Pc)"-VIc")- 



The equality now follows from a — 1 = 1 — (2 — a). □ 



APPENDIX C: ESTIMATE OF ff;i,i„(A B)p 

The following lemma gives an estimate of the smooth 
min-entropy H^i-a{A\Q) p (see also psj): 

Lemma 15. Let Pab G S{Hab), ctb G S{Hb) and A > 0, 
then 



H^,MB)p\,>-logX, £= V2tr(A), (CI) 

where A :— {pab — AIa <8) (7b}+ *s the positive part of the 
operator p^B — Al 

a f^B ■ 

Proof. Wc first choose Pab, bound H^^^^{A\Q)p\„, and 
then show that Pab G 'B^(pab)- We use the abbreviated 
notation A := AIa ® ctb and set 

Pab := GpabG^ G := A5 (A + A)-^ , 

where the inverse is taken on the support of A. From the 
definition of A, we have Pab < A -|- A; hence, Pab < A 
and iJ^i„(A|B)p|<^ > - log A. 

Let IV') be a purification of Pab, then {G ® 1ab)|'0) is 
a purification of Pab and, using Uhlmann's theorem, we 
find a bound on the fidelity: 

F(Pab,Pab) > KV'IG^IabIV')! > 3fi{tr(GpAB)} = tr(GpAB) 
where we introduced G := ^(G + G^). Hence, 



G(p AB ; Pab 

) < V (1 + tr(GpAB))(l - tr(GpAB)) • 

This can be simplified further after we note that G is a 
contraction.^'^ To see this, we multiply A < A + A with 
(A 4- A)~2 from left and right to get 

G^G = (A + A)-U(A + A)-5 < Iab. 

Furthermore, G < Iab, since ||G|| < 1 by the triangle 
inequality and ||G|| = ||Gt|| < 1. Clearly, tr(GpAB) < 1- 
Moreover, 

l-tr(GpAB) = tr((lAB ~ G)pab) 

< tr(A + A)-tr(G(A + A)) 

= tr(A + A)-tr((A + A)V^AV^) 

< tr(A), 

where we used Pab < A -f A and \/A+~A > \/A. The 
latter inequality follows from the operator monotonicity 
of the square root function (Proposition V.1.8 in [20|). 
Finally, G(pAB,yOAB) < \/2tr(A) = e and Pab G S''(Pab)- 

□ 



A contraction G is an operator with operator norm ||G|| < 1. 
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Remark 16. For a fixed e G [0,1] and supplpe} C 
supp{(Tb}i we can always find a finite A s.t. Lemma 1151 
holds. To see this, note that 



o-b}h 



is continuous in A with e(0) 
e(2-^„.„(A|B),|„) ^0. 



\/2 and 
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